The limited ability of current influenza virus vaccines to protect from antigenically drifted or shifted viruses creates a public health problem that has led to the need to develop effective, broadly protective vaccines. While current influenza virus vaccines mostly induce an immune response against the immunodominant and variable head domain of the hemagglutinin, the major surface glycoprotein of the virus, the hemagglutinin stalk domain has been identified to harbor neutralizing B-cell epitopes that are conserved among and even between influenza A virus subtypes. A complete understanding of the differences in evolution between the main target of current vaccines and this more conserved stalk region are missing. Here, we performed an evolutionary analysis of the stalk domains of the hemagglutinin of pre-pandemic seasonal H1N1, pandemic H1N1, seasonal H3N2, and influenza B viruses and show quantitatively for the first time that the stalk domain is evolving at a rate that is significantly slower than that of the head domain. Additionally, we found that the cross-reactive epitopes in the stalk domain targeted by broadly neutralizing monoclonal antibodies are evolving at an even slower rate compared to the full head and stalk regions of the protein. Finally, a fixed-effects likelihood selection analysis was performed for these virus groups in both the head and stalk domains. While several positive selection sites were found in the head domain, only a single site in the stalk domain of pre-pandemic seasonal H1 hemagglutinin was identified at amino acid position 468 (H1 numbering from methionine). This site is not located in or close to the epitopes of cross-reactive anti-stalk monoclonal antibodies. Furthermore, we found that changes in this site do not significantly impact virus binding or neutralization by human anti-stalk antibodies, suggesting that some positive selection in the stalk domain is independent of immune pressures. We conclude that, while the stalk domain does evolve over time, this evolution is slow and, historically, is not directed to aid in evading neutralizing antibody responses.